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Abstract 

This paper introduces an extension of Answer Set Pro- 
gramming called Preference Set Constraint Programming 
which is a convenient and general formalism to rea- 
son with preferences. PSC programming extends Set Con- 
straint Programming introduced by Marek and Remmel 
( IMarek an d Remmel 2004 ) by introducing two types of pref- 
erence set constraint atoms, measure preference set constraint 
atoms and pre-ordered preference set constraint atoms, which 
are extensions of set constraint atoms. We show that the 
question of whether a PSC program has a preferred stable 
model is CoNP-complete. We give examples of the uses of 
the preference set constraint atoms and show that Answer 
Set Optimization f Brewka, Niemela, and Truszczynski 2003 [ > 
and General Preference dSon and Pontelli 2006) can be ex- 
pressed using preference set constraint atoms. 



Introduction 



The notion of a set constraint (SC) atom and a set con- 
straint logic program was introduced by Marek and Remmel 
in (IMarek and Remmel 2 004). In this paper we extend these 
notions to define preference set constraint (PSC) atoms and 
PSC logic programs. The purpose of these extensions is to 
use PSC atoms to express preferences. 

PSC programming is an intuitive and general formal- 
ism for expressing preferences. We demonstrate its gen- 
erality by showing that PSC programing can be used to 
express optimal stable models of Answer Set Optimiza- 
tion (ASO) of ( [Brewka, Niemela, and Truszczynski 2003 1 
and general preferences of (" Son and Pontelli 2006) . An ex- 
tension of PSC programming can be used to express pre- 
ferred answer sets and weakly preferred answer sets of 
(IBrewka and Eiter 1999) . However, due to space limitations, 
we will not discuss the last two examples. 

In this paper, we shall focus on the formal definitions of 
PSC programming. However, there are a number of interest- 
ing issues concerning the best way to implement PSC pro- 
grams. While such issues are for the most part outside of the 
scope of this paper, we note that an implementation of PSC 
programming will not necessarily be a simple application of 



the definitions. The question of what is the best way to im- 
plement PSC programming efficiently is one that requires 
additional research, and we will only briefly discuss a few 
salient implementation issues in this article. 

The subject of expressing preferences using An- 
swer Set Programming (ASP) has been discussed ex- 
tensively in the literature. Various approaches have 
been proposed. We refer the reader to the article 
( [Brewka, Niemela, and Truszczynski 2008| l for an accessi- 
ble overview of the subject and to a more detailed albeit 
older survey ( Delgrande et al. 2004 ). 

In (Delgrande et al. 2004 1 various approaches are classi- 



fied for handling preferences in nonmonotonic reasoning. 
The paper identified the following criteria. 

• Host system. This is a particular formalism which is ex- 
tended to handle the preferences. In our case the host sys- 
tem is a SC logic program. 

• What is the preference ordering an ordering on? PSC 

programming allows the user to directly specify prefer- 
ence orderings on sets of atoms. 

• Meta-level vs. object-level preferences. This criteria 
identifies whether preferences are imposed "externally" 
on the host system, or the preferences are used within the 
object theory. Our approach is a meta-level approach. 

• Static vs. dynamic preferences. This criteria specifies 
whether the preferences are fixed at the time that the the- 
ory is specified or can be determined "on the fly". PSC 
programming implements static preferences. 

• Properties of the preference ordering. PSC program- 
ming enforces a pre-order on the set of PSC stable mod- 
els. 

• Prescriptive vs. descriptive preferences. This criteria 
concerns preference orderings on the rules and is not ap- 
plicable to PSC programming. 

• From preference to preferred results. This criteria iden- 
tifies broad categories for methods that generate preferred 
answer sets from a theory and a set of preferences. In PSC 
programming preferred PSC stable models are standard 
PSC stable models satisfying additional criteria. 
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As noted in (Delgrande et al. 2004), the majority of 
ASP type systems that reason about preferences use a 



preference ordering on the set of rules to express pref- 
erences. An example of such an approach is given in 
dBrewka and Eiter 1999) . There are exceptions such as 
for instance JSakama and Inoue 20001 1. jBrewka 2002 1 that 
specify preferences on the literals and more recently ASO 
which uses a second preference program to specify prefer- 
ences on the answer sets. ASO is in fact the approach that is 
closest to PSC programming. 

Delgrande et al. note that to have the most general ASP 
type system that can reason about preferences, one must be 
able to handle preferences on sets of objects. PSC program- 
ming allows the user to specify preferences on subsets of 
atoms. This fact distinguishes PSC programming from most 
other approaches for expressing preferences in ASP. PSC 
programming is different from ASO in that the host system 
of PSC programming is a SC logic program, whereas the 
host system of ASO is an ASP logic program. We will show 
that ASO programming can be viewed as a particular case 
of PSC programming. 

Since literals can be viewed as sets of cardinality 1, there 
are similarities between PSC programming and some of the 
proposals that specify preferences on the literals. Due to the 
space constraints we will limit the related discussion to few 
remarks. 

In jBrewka 20021 ) Brewka introduces Logic Programs 
with Ordered Disjunction (LPODs). The key feature of 
LPODs are ordered disjunctions of the form Ci x ... x C„ 
in the heads of the rules. The meaning is that if pos- 
sible Ci, if not possible Ci then C2, ..., if not possi- 
ble Ci, ...,C„_i then C„. The priorities among the an- 
swer sets of LPODs are generated using the indices of 
the disjuncts included in the stable models. As shown in 



(Brewka, Niemela, and Syrjanen 2004 > deciding whether S 
is a preferred answer set of LPOD P is coNP-complete, 
which is the complexity of the same problem for PSC pro- 
grams. Thus a polynomial time translation between the for- 
malisms exists. 

In ( [Buccafurri, Leone, and RuUo 200 0), Buccafurri et al. 
extend the language of Disjunctive Datalog by weak con- 
straints (DATALOG^'^'^). The weak constraints are con- 
structs of the form <= Li, ..., L„ where Li, ..., L„ are lit- 
erals. The weak constraints effectively allow to specify sets 
of atoms, i.e. a weak constraint specifies those sets of atoms 
that violate the consti-aint. T is a model of a DATALOG^'" "= 
program if F is a model of the underlying Disjunctive Dat- 
alog program and if it minimizes the sum of the weights 
of the violated weak constraints. DATALOG^'^'^ programs 
possess a certain similarity with the measure PSC programs. 
In particular both specify preferences on sets and both use 
numeric weights for the models. However, there are sig- 
nificant differences between the two approaches. First, the 
host system of DATALOG ^"''^ is Disjunctive Datalog pro- 
grams. For the measure PSC programs it is SC programs. 
Second, integer weights associated with candidate models 
in DATALOG^'^'^ allow the use of a binary search proce- 
dure in finding models, whereas the use of binary search is 
not helpful for the measure PSC programs since the stopping 
criteria is not easily determined due to the arbitrary weights. 
Thus if the complexities of the host systems were the same. 



the complexities of the search for optimal models would be 
different in the two approaches. 

The rest of the paper is structured as follows. In section 
2, we will describe the preliminaries of ASP and SC logic 
programming. In section 3, we will introduce PSC program- 
ming. In the same section there will be a discussion pertain- 
ing to implementing PSC programming. In section 4 we will 
show that PSC programming can be used to express optimal 
stable models of ASO. In section 5 we will show that the 
general preferences of (ISon and Pontelh 2006t can be ex- 
pressed using PSC atoms. In section 6, we will discuss com- 
putational complexity of PSC programming. In section 7, we 
will give conclusions and directions for further research. 

Preliminaries 

Answer Set Programming. 

Answer set programming is logic pro- 
gramming with stable model or answer 
set semantics jGelfond and Lifschitz 1988] l. 

jGelfond and Lifschitz 199 II I. ASP systems are ideal 
logic-based systems to reason about a variety of types of 
data and integrate quantitative and qualitative reasoning. 
The question of whether a finite propositional logic pro- 
gram has a stable model is NP-complete dElkan 1990l l. 
(MarekandTruszczynski 1991 1. It is also the case that 



any NP search problem can be (uniformly) reduced to the 
problem of finding a stable model of a finite propositional 
logic program ( Marek and Remmel 2003) . 

A normal propositional logic program P consists of rules 
of the form 

C = a <— fli, ..., am, notbi,..., not bn 

where a, oi, . . . ,a,„, 61, . . . , 6„ are atoms and not is a 
non-classical negation operator The set prem (C) = 
{ai,...,am} is called the set of premises of rule C and the 
set cons (C) = {&i, . . . , 6„} is called the set of constraints 
of rule C. The atom a is called the conclusion of rule C 
and is denoted by c (C). Either prem{C), cons{C), or both 
may be empty. Let H{P) denote the Herbrand base of P. 
A subset A/ C H{P) is called a model of a rule C if 
prem{C) C M and cons{C) n Af = implies c{C) G M. 
M is a model of a program P if it is a model of every rule 
of P. 

Given M C H{P), the Gelfond-Lifschitz transform 
P*^ of P with respect to M is obtained by removing 
every rule C such that cons (C) fl Af 7^ and then 
removing the constraints from all the remaining rules. M 
is called a stable model of P if M is the least model of P*^. 

Set Constraint Logic Programming. 

Set constraint programming was introduced 
in jMarek and Remmel 2004l l as an extension of 
DATALOG^. It generalized Answer Set Programming 
(ASP) with cardinality constraint atoms or weight constraint 
atoms as defined in (|Niemela, Simons, and Soininen 1999| l, 
( INiemela and Simons 2000r 

Suppose that we are given a finite set of atoms X. We 
let V {X) denote the set of all subsets of X. A set constraint 
atom over X is a pair {X, F) where F C V {X). Given a set 



of atoms M and a SC atom {X, F), we say that M satisfies 
(X, F) (or M is a model of {X, F)) and write M h (^, i^) 
if M n X e F. 

A 5ef constraint (SC) rule C is an expression of the form 

S <- Si, ...,Sfc 

where s, si, ..., Sk are SC atoms. The set body (C) = 
{si, ..., Sfc} will be referred to as the body of the rule C and 
the atom c (C) = s will be referred to as the conclusion of 
the rule. A set of atoms M is a model of C (or A/ satisfies 
C) if Af ^ si, ..., M ^ Sfc implies M |= s. An SC program 
P is a set of SC rules and a set of atoms M is a model of P 
if A/ is a model of every rule in P. 

We note that the satisfaction of literals can be easily ex- 
pressed in terms of the satisfaction of set constraints. That 
is, for an atom a, M ^ a if and only M ^ ({a} , {{a}}) 
and M ^ not a if and only if A/ ^ {{a} , {0}). Thus each 
literal a or not a in a normal logic program can be written 
as a SC atom and hence each normal logic program can be 
considered as SC logic program. However such a translation 
makes normal logic programs harder to read. Thus, in what 
follows, we shall write a for the SC atom {{a} , {{a}}) and 
not a for a SC atom ({a} , {0}). 

Given an SC atom {X, F), the upper-closure F of F 
with respect to X is the family F = {Y C X\ 3Z 
{Z e F A Z C Y)}. A family F of subsets of X is closed 
if F ^ F. Notice that the closure of a closed family F of 
subsets of X is F itself. The closure of a SC atom {X, F) is 
(X,F). 

A Horn SC rule is a SC rule where the head of the rule is 
an ordinary atom and all SC atoms in the body are closed, 
i.e. a rule of the form 

p^(X,Fi),...,(X,F„) 

where for i = 1, 2, ..., n, Fi = Fi. The reason for call- 
ing such a rule Horn is that if M satisfies a Horn SC rule 
C, then all the supersets of A/ will satisfy C. A Horn SC 
logic program (Horn SC program for short) is a SC program 
consisting entirely of Horn SC rules. Given a Horn SC pro- 
gram P, we define the one-step provability operator Tp by 
letting Tp{M) equal to the set of all p such that there exists 
arulep^ (X,Fi),...,(X,F„) in P where Af \= {X,F,)foT 
i = 1, . . . , n. It is easy to prove that the one-step provabil- 
ity operator associated with a Horn SC program is mono- 
tone and hence a Horn SC program P has a least fixed point 
which is the smallest model of P. 

The notion of SC stable model of a SC logic program is 
defined using a modification of the Gelfond-Lifschitz trans- 
form called NSS transform. That is, let P be a SC pro- 
gram and let M be a subset of atoms. The NSS transform, 
NSS (P, M) of P with respect to M is defined in two steps. 
First, eliminate from P all rules whose bodies are not sat- 
isfied by M. In the second step, for each remaining rule 
{X, F) ^ (Xi, Pi), ..., {Xk,Fk) and for each aG XOM 
generate the rule a i- (^Xi,Fi),..., (^Xk,Fk) . The resulting 
program NSS (P, M) is a Horn SC program. Consequently, 
NSS{P, M) has a least model Np^m- M is called a SC sta- 
ble model of P if M is a model of P and M = Np^m- 



Marek and Remmel in ( jMarek and Remmel 20041) proved 
the following proposition showing the equivalence of a nor- 
mal logic program and its representation as SC program. 

Proposition 1. Let P be a normal logic program and let 
M be a set of atoms. Then M is a stable model of P in the 
sense of Gelfond and Lifschitz if and only if M is a stable 
model of P viewed as SC program. 

Preference Set Constraints in Logic Programs 

In this section, we will define two types of preference 
set constraint atoms, measure PSC atoms and pre-ordered 
PSC atoms, and two types of preference set constraint pro- 
grams, measure PSC programs and pre-ordered PSC pro- 
grams which are extensions of SC atoms and SC programs, 
respectively. We will also discuss some of the issues related 
to the possible implementations of PSC programming. 

A measure preference set constraint (measure PSC) atom 
is a triple (X, P, pp) where {X, F) is a SC atom and pp : 
F -^ [— oo, oo] is a measure function. The SC reduct of 
{X,F,pf), red{{X,F,pp)), is just the SC atom {X,F). 
A pre-ordered preference set constraint (pre-ordered PSC) 
atom is a triple {X,F,<p) where {X,F) is a SC atom 
and <i? is a pre-order on P. The SC reduct of {X, F,<p), 
red{{X, F, <f)), is just the SC atom {X, F). If M is a set 
atoms, we say that M is a model of {X,F,pp) if M \= 
{X, F) and M is a model of {X, F,<f) if M ^ (X, P). If 
{X, F) is a SC atom, then we let red({X, F)) = {X, F). 

A measure PSC rule C is a rule of the form 



s ^ Si 



■ ,Sfe 



where si , . . . , Sfe are SC atoms and s is either a SC atom or a 
measure PSC atom. We define the SC reduct of C, denoted 
by red{C), to be the rule red{s) <— si, . . . , s^. A measure 
PSC program P is a set of measure PSC rules and we define 
the SC reduct of P to be the set of red{C) such that C is in 
P. We say that a set of atoms A/ is a model of P if and only 
if Af is a model of red{P) and Af is a stable model of P if 
and only if it is a stable model of red{P). 

Similarly, a pre-ordered PSC rule C is a rule of the form 
s <— si, . . . ,Sk where si, . . . ,Sk are SC atoms and s is 
either a SC atom or a pre-ordered PSC atom. We define 
the SC reduct of C, denoted by red{C), to be the rule 
red{s) <— si, . . . ,Sk- A pre-ordered PSC program P is a 
set of pre-ordered PSC rules and we define the SC reduct of 
P to be the set of rediC) such that C is in P. Again we say 
that a set of atoms M is a model of P if and only if M is a 
model of red{P) and Af is a stable model of P if and only 
if it is a stable model of red{P). 

Our idea is that if we are given a measure PSC program or 
a pre-ordered PSC program P, then the preference set con- 
straint atoms can be used to induce a pre-order on the set of 
stable models of P. Before we can talk about this induced 
pre-order, we need to define a pre-order on the models of a 
set of PSC atoms T. That is, suppose that T is a set of pre- 
ordered PSC atoms and we are given two sets of atoms Mi 
and A/2 which satisfy every element of T. Then we say that 
Af 1 is preferred to M2 relative to T, written T \= Mi -< M2 
if for all {X, F,<f) G T, Mi DX <p M2nX and there is 
at least one {X, F,<f) £ T such that MiDX <f M2 n X. 



(Here, as usual for two sets A and B and a pre-order <, 
A < B denotes A < B md B ^ A). We say that Mi is 
equivalent to M2 relative to T, written T ^ Mi ~ M2 
if for all {X,F,<f) € T, Mi n X <f M2 Ci X and 
A/2 n X <p Ml n X. Hence, our pre-order on the mod- 
els of T is essentially a product order over the set of lo- 
cal preference orders induced by each of pre-ordered PSC 
atoms in T. We say that Mi is indistinguishable from M2 
relative to T, written T |= Mi « M2 if T ^ Mi -< M2 and 
T ^ A/2 ^ A/i. 

A slightly weaker type of pre-order on models can be in- 
duced by measure PSC atoms. That is, given a set T of mea- 
sure PSC atoms and two sets of atoms A/i and A/2 which 
are models of T, we say that Mi is weakly preferred to M2 
relative to T, written T |= A/i -<^ M2 if 

Y, PFiMinX)< J2 PFiM2nX). (I) 



{X,F,pf)£T 



{X,F,pf)gT 



Note that for A/i to be weakly preferred to A/2 relative 
to T, we do not require that for every {X,F,pf) G T, 
Pf{Mi n X) < pf{M2 n X), but only in the aggregate 
Ml is preferred to A/2. This type of pre-order induced on 
models of sets of measure preference atoms allows the user 
more flexibility in specifying preferences. This is because 
one is allowed to weigh local preferences so that the weight 
coming from the pp associated with the measure PSC atom 
{X,F,pp) makes a much bigger contribution to ([T) than 
the weight coming from the pc associated with the measure 
PSC atom {Y, G, pc)- Thus it is possible to make sure that 
the local preferences specified by {X, F, pp) are much more 
important than the local preferences specified by {Y, G, pc)- 
We say that A/i is indistinguishable from A/2 relative to 
T, written T \= Mi «^ A/2 if T ^ A/i -< M2 and 
T ^M2 ^ Ml, i.e. 

J2 PFiMinx)^ J2 PF{M2r\X). 



{X,F,pf}<£T 



{X,F,pF}eT 



We are now in position to define how we can use PSC pro- 
grams to specify preferences on stable models. We will start 
out considering what we call simple PSC programs. A sim- 
ple pre-ordered PSC program is a pre-ordered PSC program 
P which consists of two types of rules: 

Ci = s ^ si,. . . ,Sk 

where s, si, . . . , Sfc are SC atoms and 



C2 



(2) 



where s is a pre-ordered PSC atom. Given a simple pre- 
ordered PSC program P, we let pref (P) denote the set of 
pre-ordered PSC atoms that appear in a rule of type (0 in P. 
Note that any stable model A/ of P must satisfy all the pre- 
ordered PSC atoms in pref{P). Given two stable models 
A/i and A/2 of P, we say that A/i is preferred to M2 relative 
to P, written P \^ Mi ^ A/2, if pref (P) \= Mi -< M2. 

Similarly, a simple measure PSC program is a measure 
PSC program P which consists of two types of rules: 



where s, si, . . . , s^ are SC atoms and 

D2=S^ 



(3) 



/?i = S <— Si, . 



. ,Sfc 



where s is a measure PSC atom. Given a simple measure 
PSC program P, we let pref (P) denote the set of measure 
PSC atoms that appear in a rule of type ^ in P. Note that 
any stable model A/ of P must satisfy all the measure PSC 
atoms in pref{P). Given two stable models A/i and A/2 
of P, Ml is weakly preferred to M2 relative to P, written 
P h Ml ^u, M2, if pref (P) h Ml ^„ A/2. 

To be practical, any implementation of PSC programming 
will have to be restricted to a class of programs that can be 
represented in a compact way. In this section we will discuss 
the algorithmic approach for implementing PSC program- 
ming - an approach that in many cases can produce compact 
representations and that is conducive to efficient and practi- 
cal implementations of PSC programming. 

The idea is that for a pre-ordered PSC atom {X, F,<p) 
or a measure PSC atom {X,F,pp) or a SC atom {X,F) 
X and F are implemented by algorithms Ax and Ap re- 
spectively. That is, for any set of atoms A/, the algorithm 
Ax returns A/ n X, and, for any set of atoms A/, the al- 
gorithm Ap returns 1 if M e F and if A/ ^ F. Thus 
an implementation of PSC rule may be a string of the form 
{X,F,q) ^ (Xi, Fi),...,(X„,/^„), where X,Xi,...,X„ 
are names of the algorithms that for an input set of atoms M 
return a subset of A/. F, Fi, ..., Fn are names of Boolean 
valued algorithms that take a set of atoms as an input. For 
a pre-ordered PSC program, q will be a three valued algo- 
rithm that takes two sets of atoms as inputs. For a mea- 
sure PSC program, q will be a real valued algorithm that 
takes a set of atoms as an input. We note that an exten- 
sion of ASP that uses arbitrary algorithms was considered 
in (IBrik and Remmel 201 11 1. 

In many cases this approach produces efficient implemen- 
tations. Consider the following example. Suppose that for a 
SC atom {X,F), F contains only those subsets of X that 
consist of an even number of elements. Implementation of 
this atom by enumerating F is clearly inefficient as there are 
2l-f |-i sefs yyii;ji even number of elements in F. Thus we do 
not want to represent F by an enumeration of all the subsets 
of X of even cardinality. However, an algorithm returning 1 
if and only if the input set has even number of elements is 
trivial to implement and will run in O (|X|) time. 

An obvious implementation can be obtained as follows. 
Let {xi, ...jXn} be an enumeration of X. Thus any subset 
of X can be represented as a vector of n binary digits (bits). 
For instance, suppose that X — {xi, ..., xg}. Consider Y C 
X where Y = {xi, X3, xq}. Then an 8 bit representation 
of A is 101001. Assuming this representation we have the 
following pseudocode for Ap. 

boolean AF (Y) 
n = size(Y); 
result = true; 
for i=l:n if Y[i] == 1 then result = "result; endfor; 

return result; 

end 



where Y[i] is the ith bit of the bit vector Y, and "result is 
the boolean NOT operation. 

Suppose that instead of the subsets of X of even cardi- 
nality we want to enforce the cardinality constraint on the 
subsets of y of X such that 3 < |y | < |X| — 3. There are 
21-^1 - 2{\X\ ■ {\X\ - 1) /2 + \X\ + 1) such subsets, and 
of course we do not want to enumerate them. However, as 
in the previous example there is a simple algorithm that will 
implement this cardinality constraint. 

boolean AF (Y) 
n = size(Y); 
cardinality = 0; 

for i= 1 :n if Y[i] == 1 then cardinality = cardinality + 1 ; endf or; 
return 3 <= cardinality && cardinality <= n-3; 

end 

PSC semantics specifies what an implementation of PSC 
programming should do. It is not a prescription for how 
PSC programming should be implemented. Thus the fact 
that PSC programming deals with sets should not be under- 
stood to mean that PSC programming has to be implemented 
by enumerating sets. Efficient implementations of PSC pro- 
gramming will not use such an approach. We will use two 
examples to motivate the fact that semantics does not neces- 
sarily prescribe how the formalism is to be implemented. 

First, consider stable model semantics. The formalism 
shows that a stable model can be found by choosing a 
subset of the Herbrand base of a logic program and then 
checking that the subset is a stable model. Now, while un- 
doubtedly useful, the formalism is impractical if imple- 
mented as stated. Indeed, modern ASP solvers such as 
smodels ([Simons, Niemela, and Soininen 200"2l l and clasp 
(IGebser et al. 2007l l use efficient algorithms to implement 
stable model semantics, where the algorithms do not rely on 
searching through the entire powerset of the Herbrand base 
of a logic program, which would be the case if the semantics 
was considered as a prescription for implementations. 

Second, consider cardinality constraint programming 
( [Niemela, Simons, and Soinin en 1999). The formalism has 
been implemented in smodels-2 (Simons 1999 11 and is gener- 
ally considered to be a practical extension of ASP. However, 
its practicality follows from the fact that efficient implemen- 
tations of cardinality constraint programming exist. 

To illustrate how the algorithmic approach for implement- 
ing PSC programming might work we will consider the 
problem of finding a vertex cover of size less than K for 
a given graph, with a preference for the covers that include 
vertex w. 

For a given graph a measure PSC program can be 
constructed as follows. For every edge (u, v) include a 
rule({u,w}, {{"},{«}}) ^, specifying that either u or 
w is in a stable model. Also include the following rule 
(y, F, pf) ■(— , where V is the set of all the vertices of the 
graph and for [/ C y [/ e i^ if \U\ < K and 



PF 



if w £ [/ 



Now, an algorithmic implementation of V is very simple: 
for any subset U of the Herbrand base V (U) = U. 



The implementation of F is very similar to the cardinal- 
ity constraint implementation above. Finally the algorithm 
roF(U) simply has to check the condition U[iw]==l, where 
iw is the index in the bit array corresponding to the atom w. 
That is Xiw ~ w. The preference can be given by any of the 
three approaches for measure PSC programs. 

The example demonstrates that compact representations 
of PSC programs can be created and that such representa- 
tions are conducive to efficiently implementing PSC pro- 
gramming. 

In many cases, simple PSC programs are adequate to ex- 
press preferences. In fact pre-ordered simple PSC programs 
will be used to express optimal stable models of ASO. 

We will now proceed with the examples illustrating how 
PSC programming can be used. 

Example 1. Bob is a Ph.D. student who is about to grad- 
uate from his university. Bob is guessing that he will have 
multiple job offers and wants to determine a method by 
which he will make his decision. Bob identifies two impor- 
tant criteria in making a decision. These are the type of in- 
stitution and its location. He thus introduces the following 
atoms: R - for the job at a research university, T - for the 
job at a teaching university, C - for the job in a company, 
CAL-for the job located in California, and NCal-for the job 
not located in California. Thus the set of atoms is X = {R, 
T, C, CAL, NCAL}. Then any offer is described by a set 
of atoms from the following family of sets: F = {{A, B} 
\ A e {R, T, C}, B e {CAL, NCAL}}. Finally Bob 
decides on the following ordering of sets <p: {R, CAL} 
<F {R, NCAL} <F {T, CAL} <f {T, NCAL} <f {C, 
CAL} <F {C, NCAL}. 

In this example and all the following examples in this sec- 
tion, we will assume that Bob is trying to decide between 
two jobs ji and J2. Thus we introduce a base program Pq. 
Pq contains the rule 

({J1,J2},{{J1},{J2}})^. 

This rule says that, in any stable model M, exactly one of ji 
and J2 is contained. Then we add rules to specify the relevant 
information about jobs ji and J2- For example, if ji is a job 
at a research university in California and J2 is a job at a 
teaching university outside of California, we would add the 
following rules: R <— ji, Cal <— ji, T <— J2, NCal <— 

h- 

Then Bob's preferences can be described by the simple 
pre-ordered PSC program Pi which consists of Pq plus the 
rule {X, F, <f) i~. □ 

Example 2. Bob soon realizes that not all locations out- 
side of California have the same weight. He is actually more 
likely to consider an offer from a location which is near Cali- 
fornia than from a location which is far from California. Bob 
thinks that a job at a research university is preferable to a job 
at a teaching university and that a job at a teaching university 
is preferable to a job at a company. Yet, Bob notices that he 
will prefer a job from a teaching university in California to a 
job from a research university which is more than 500 miles 
away from California. 



He thus revises his original approach. There are still 
predicate atoms R, T, C to specify a research university, 
or a teaching university or a company respectively. How- 
ever, now Bob introduces a set of predicate atoms D = 
{D (x) \x e N}, where N is the set of natural numbers and 
D (x) indicates a distance x from California. Thus D (0) 
indicates that the location of the job is in California. Note 
that in an implementation of PSC programming D can be an 
algorithm that on an input M will simply return the set of 
atoms in M of the form D{x) for a; G N. While D repre- 
sents an infinite set, its implementation can be compact and 
efficient. 

Now let Z = {R, T, C}U D and let H = {{A, B}\ 
A e {R, T, C}, B € ID}. Bob defines a measure function 
as follows ph {{A, D (x)}) = t (A) + x where r (R) = 0, 
T (T) = 500 and t (C) = 1000. 

Thus Bob's preferences are specified by the simple mea- 
sure PSC program which consists of Pq plus the rule 

{z, H, ph)^- a 

If we consider more general pre-ordered PSC programs 
P and measure PSC programs, then we have several natural 
choices for how to induce a pre-order on the set of stable 
models of P. If P is a pre-ordered (measure) PSC program 
and M is a stable model of P, then we let pref {P, M) de- 
note the set of all pre-ordered (measure) PSC atoms s such 
that there is a rule C — s ^r- si, . . . ,Sk where s is a pre- 
ordered (measure) PSC atom and M satisfies the body of C. 
Since all stable models of P are models of P by definition, 
M must be a model of pref {P, M). 

Note, however, that if Mi and M2 are stable models 
of P it is not necessarily the case that pref {P, Mi) = 
pref{P,M2)- Now in the case where pref (P, Mi) = 
pref{P, M2), the obvious thing to do for the pre-ordered 
PSC programs is to say that Mi is preferred to M2 relative 
to P if and only if pref {P, Mi) |= Mi ^ M2. However, if 
pref{P, Ml) 7^ pref{P, M2), then one has several natural 
choices. First, one can simply consider the pre-ordered PSC 
atoms in pref{P, Mi) n pref{P, M2), i.e. the pre-ordered 
PSC atoms which are the conclusions of rules of P which 
are satisfied by both Mi and M2. Thus we say that Mi is in 
common preferred to M2 relative to P, written P ^ Mi -<ic 
M2, if and only if pref{P, Mi) D pref{P, M2) h Mi -< 
M2. A second natural choice that one might want to use in 
certain situations is to take the point of view that satisfying 
a pre-ordered PSC atom s that appears in the head of a rule 
in P is more preferable than not satisfying s. Thus we say 
that Ml is in total preferred to M2 relative to P, written 
P 1= Ml ^it M2, if and only if either (a) pref{P, Mi) D 
pref{P,M2) and either pref {P, Mi) f) pref{P,M2) h 
Ml -< M2 or pref {P, Ml) npref{P,M2) ^ Mi ~ M2 
or (b) pref {P, Ml) = pref{P,M2) and pref{P,Mi) n 
pref(P,M2) ^Mi^M2. 

Example 3. As Bob has more time to contemplate the job 
offers, he realizes that his life will be simplified if the job is 
in a town where there is a good public transportation system. 
Also, being a classical music lover. Bob considers an easy 
access to live classical concerts as one of the factors in mak- 
ing his decision. Not being sure about the weight that public 



transportation and live classical music concerts should have 
in the decision making process, he reverts to the pre-ordered 
PSC program from Example 1 . Bob reasons that he will keep 
his preferences as they already are, except when there is an 
access to live classical music concerts in the area. In that 
case, a location outside of California with a good system of 
public transportation is preferable to a location in California 
without such a system. Thus Bob introduces two new pred- 
icate atoms: CM - to indicate the presence of local access 
to live classical music concerts and PT to indicate the pres- 
ence of a good system of public transportation. Bob adds a 
new rule to the program Pi to produce a new program P3. 
P3 consists of Pq plus the following two rules: 

(X, P, <f) ^ (r, G, <g) ^ CM 

where Y = {CAL, NCAL, PT}, G = {{CAL, PT}, 
{NCAL, PT}, {CAL}, {NCAL}} and {CAL, PT} <g 
{NCAL, PT} <G {CAL} <g {NCAL}. 

Now P3 1= M2 -<ic Ml since pref {P3, Mi) n 
pref{P3,M2) = {{X, F, <f)} and {X, F, <f) h 
M2 < Ml. However P3 |= Mi Ria M2 be- 
cause pref {P3, Ml) D pref{P3,M2) and {X, F, 
<f) h M2 -< Mi.D 

Similarly we can define a pre-order on the set of sta- 
ble models of measure PSC programs. In the case where 
pref {P, Ml) = pref{P,M2), the obvious thing to do is 
to say that Mi is weakly preferred to M2 relative to P 
if and only if pre/ (P, Ml) ^ Mi ^^ M2. However, if 
pref {P, Ml) ^ pref{P,M2), then one has several nat- 
ural choices. One is to simply consider the measure PSC 
atoms in pref{P, Mi) r\pref{P, M2), i.e. the measure PSC 
atoms which are the conclusions of rules of P which are 
satisfied by both Mi and M2. Thus we say that Mi is 
in common weakly preferred to M2 relative to P, writ- 
ten P t= Ml ^u,,ic M2, if and only if pref {P, Mi) 
pref{P,M2) \= Ml -<uj M2. As before, our second nat- 
ural choice is to take the point of view that satisfying a mea- 
sure PSC atom s that appears in the head of a rule in P 
is more preferable than not satisfying s. Thus we say that 
Ml is in total weakly preferred to M2 relative to P, writ- 
ten P ^ Ml ^^^it M2, if and only if (a) pref{P, Mi) D 
pref{P, M2) and either pref{P, Mi) n pref{P, M2) \= 
Ml ^^ M2 or pref [P, Mi)npref{P, M2) h Mi «^ M2 
or (b) pref {P, Ml) = pref{P,M2) and pref {P, Mi) D 
pref{P,M2) h Ml ^^ M2. We also have a third 
natural choice that one might want to use in certain 
circumstances which is just to compare the two sums 
E(x,F,p^)epre/(p,Mi) PpiMi D X) and 
E(x,F,p^)epre/(P,M.) P^ (^2 H X). Thus we say that Mi 
is in sum weakly preferred to M2 relative to P, written 
P h Ml <^^,s M2, if 
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Definition 1. A set of atoms M is called an in common 
preferred PSC stable model of a pre-ordered PSC program 
P if M is a PSC stable model of P and for all PSC stable 
models M' of P, P ^ M' <ic. M. 

An in total preferred PSC stable model, an in common 
weakly preferred PSC stable model, an in total weakly pre- 
ferred PSC stable model, an in sum weakly preferred PSC 
stable model are defined similarly. To refer to any of these 
definitions without explicitly naming them we may say that 
M is a preferred PSC stable model of a PSC program P. 

PSC Programs and Answer Set Optimization 
Programs 

As was stated in the introduction, the closest approach to 
PSC programming is ASO. In ASO, one starts with an ASP 
program Pgen over a set of atoms At and then a prefer- 
ence specification is given by a separate preference program 
Ppref- The rules of Ppref are of the form 

Ci > ... > Cfe <— ai, ..., an, not bi, ..., not b„i (4) 

where a^s and bjS are literals and the C,s are Boolean com- 
binations over At. Here a Boolean combination over At is 
a formula built of atoms in A by means of disjunction, con- 
junction, strong negation -i and default negation not, with 
the restriction that strong negation is allowed to appear only 
in front of atoms, and default negation is allowed to appear 
only in front of literals. 

Next suppose that we are given a set of literals S. Then the 
definition of S satisfying a Boolean combination C, written 
S \= C, uses the standard inductive definition of satisfaction 
of propositional formulas except that S |= not I where / is 
literal if and only if I ^ S. Then we define the satisfaction 
degree vs (r) for any rule of the form of (3) by setting (i) 
vs (f) — I if either the body of r is not satisfied by S or the 
body of r is satisfied by S, but none of the C^s are satisfied 
and (ii) vs (r) = min{i : S ^ Ci} if the body of r is satis- 
fied by S and at least one of the C^s is satisfied by S. This 
allows one to define a satisfaction vector Vs = {vs (ri), 
..., Vs (»"n)) for any answer set S of Pgen for a preference 
program Ppref = {ri, ..., r„}. 

One can then use satisfaction vectors to define a pre-order 
on answer sets of Pgen as follows. First for any two possible 
values a and b of vs (r) (i) a > b if a = I and b — 1 or if 
a ~ I and b ^ I, (ii) a > bif a = I and b G {2, 3, ...}, and 
(iii) a > b if a, b E {1, 2, ...} and a < b relative to the usual 
order on the natural numbers. Then for two sets of literals 5*1 
and 5*2 Vs, > Vs^ if vs, (ri) > vs^ {ri) for every i e {1, 
..., n} Vsi > Vs2 if Vs, > Vs2 and for some i £ {1, ..., n} 
vs, in) > VS2 in). Si > S2 if Vs, > Vs, and Si > S2 if 
Vs, > Vs2 ■ Finally, a set of literals S is an optimal model of 
an ASO program {Pgen, Ppref) if S is an answer set of Pgen 
and there is no answer set S" of Pgen such that S" > S. 

We will now show how optimal models of an ASO 
program can be expressed using PSC programming. Let 
{Pgen, Ppref) be an ASO program. 

Let At be the set of all atoms that occur in the rules of 
Pgen and Ppref- Notc that any stable model of A of Pgen 
must be a subset of At. Consequently, any optimal model of 
{Pgen, Ppref) must be a subset of At. 



Let Ppref consist of the rules Wi, W2, ..., W^ where 



> CI 



., a!,., not 



Wi is of the form CJ > 
b\,..., notbln^. 

We will now construct a simple pre-ordered PSC program 
P and we will show that there is a one-to-one correspon- 
dence between the preferred PSC stable models of P and 
the optimal stable models of {Pgen, Ppref)- 

The Herbrand base H {P) of P will consist of At, the set 
At — {a\ a £ A} where for a G At a is a new atom not 
in At, and where for all a, b £ At if a y^ b then a ^ b, 
and a new atom D so that D ^ At^~Ai. That is H (P) = 
At\J~At\J{D]. 

For a set A C At define A = {a\ a £ A}. For a rule 
Wi £ Ppref let At {Wi) be the set of all the atoms that occur 
inW,. 

We define a PSC program P'e f '^o be the set of all rules 



At{W,), V{At{W,)), <, 



The pre-order <i is defined as follows. For A C At, B C At 
A <i B if one of the following conditions hold. 

L A ^ body {Wi); 2. A ^ body {Wi) and A ^ c {Wi); 
3. A ^ body{W^) and A \^ €{; A. A \^ body{Wi) and 
A \= CI where z is minimal and B \= body {Wi) and 
B ^ Cj where j is minimal and z < j, i.e., A <i B iff 
VA {W.,) > VB (VK,). 

Let Peons be the set of rules consisting of two rules for 
each a £ At a <— a and D <r-a, not a, not D. 

Then the PSC program P is defined by P = Pgen U 
P' IIP 

^ pref ^ ^ cons- 

We can prove the following two theorems. 

Theorem 1. 7. For all B C At, if B is a stable model of 
Pgen in the sense of Gelfond and Lifschitz, then B U B is a 
stable model of P in the set of PSC. 

2. For all A C H (P), ;/ A is a stable model of P in the 
sense of PSC, then A — B U B where B is a stable model 
of Pgen in the sense of Gelfond and Lifschitz. 

Theorem 2. 1. If B is an optimal stable model of 
{Pgen, Ppref), then B U B is a preferred PSC stable model 
of P. 

2. If A is a preferred PSC stable model of P, then AClAt 
is an optimal stable model of {Pgen, Ppref)- 

A reasonable concern in the construction of P is 
the efficiency of the implementation of the PSC atoms 



At{Wi), 'P{At{W^)), <j ).The implementation of such 

an atom can be a string {X, F, O) where X, F, O are the 
names of the algorithms. The algorithm corresponding to X 
on the input set of atoms M will return At{Wi) fl M. The 
algorithm corresponding to F will always return 1 since any 
subset of At{Wi) n M is in V{At{Wi)). The algorithm 
corresponding to O on the inputs A and B will return 1 iff 
A <i B and otherwise. The algorithm for O can be as ef- 
ficient as the algorithm in the implementation of ASO. Our 
algorithm can use the ASO algorithm to check the conditions 
A h body{W^), A h c{W^), B h body{W^), A h CI, 
B \= CI that are necessary for its evaluation. 



Using PSC Programs to Express General 
Preferences 

In this section we will show that the general preferences of 
(^on and Pontelli 2006) can be expressed using PSC atoms. 
In jSon an d Pontelli 2006), the language W for planning 
preferences specification was introduced. VP allows users 
to elegantly express multi-dimensional preferences among 
plans that achieve the same goal. In W, users can define 
general preferences by building them from simpler atomic 
preferences using a small number of special operators. 

A basic desire formula (basic desire for short) is a for- 
mula expressing a single preference about a trajectory. Son 
and Pontelli provide a formal definition of the notion of ba- 
sic desire, as well as a formal definition of the notion of a 
trajectory, and define what it means for a trajectory to sat- 
isfy a basic desire. For the purposes of this paper, it is not 
necessary to restate these definitions. It will suffice to as- 
sume that a basic desire is a formula in some language 
and that, for any trajectory a, we can determine whether a 
satisfies (j), written a ^ 0, or whether a does not satisfy (f), 
written a ^ (f). We will also assume that each basic desire 
corresponds to a unique predicate atom. In addition, we will 
use the basic desires and the predicate atoms corresponding 
to them interchangeably. 

Let be a basic desire formula and let a and /? be two 
trajectories. The trajectory a is preferred to the trajectory 
/3, written a -<0 /?, if a \= 4> and /3 ^ (j>. a and /3 are 
indistinguishable with respect to (f>, written a w^ (3, if either 
(1) a \= (j) and P ^ (I) or (2) a ^ and /3 ^ 0. 

An atomic preference formula is defined as a formula of 
the type (/)i < (f>2<i...<i(f>n where (pi, ..., (j>n are basic de- 
sire formulas. If a and /3 are trajectories and ip — (pi <i 
02<---<0n is an atomic preference formula, then we say 
a and /3 are indistinguishable with respect to ■0 (written as 
a ~^ ^) if Vi (1 < i < n => a «0. /3) and a is preferred 
to /3 with respect to ip (written as a -<^ /3) if 3 (1 <i < n) 
such that y {I < j < i) a «0 . /3 and a -<^^ f3. 

The set of general preference formulas (general prefer- 
ences) are defined via the following inductive definition: (i) 
every atomic preference formula i/; is a general preference 
formula, (ii) if i/'i, tp^ are general preference formulas, then 
ipik,ip2, tpi\tp2, and lipi are general preference formulas, and 
(iii) if tpi, tp2, ..., tpk are general preference formulas, then 
tpi <i ip2<i ■ ■ ■ <iipk is a general preference formula. 

Let iphea general preference formula and let a, /3 be two 
trajectories. Then we say a is preferred to /3 with respect to 
-0 (written a ^^ /3) if: 

1. 1/) is an atomic preference formula and a -<^ (3 

l.ip = '\pih'\p2 and a ^^^ /3 and a ~<^^ /3 

3. V' = ^i\'(p2 and (a ^^^ /3 and a w^^ 13) or (a w^^ (3 
and a -<-^^ [3) or {a -<^i j3 and a ^^^ P)- 

4. t/; =!7/'i and (3 ^^^ a 

5. ip = ipi <\ ip2<i ■ ■ ■ <i''Pk, and there exists 1 < i < k 
such that (V (1 < j < i) a «^ . /3 and a -<^^ (3) 

We say a is indistinguishable from j3 with respect to ip 
(write a «^ p3) if: 

1 . i/) is an atomic preference formula and a ~^ (3 



2. ip = ipik,ip2, a ~i^j /3 and a w^^ P 

3. Ip — "01 1'02, ct w^,j /3 and a «^2 /3 

4. ^p —lipi and a ~^^ (3 

5.ip = ■^pl<i^p2<i ■ ■ ■ <iipk, and for all 1 < i < ka 



/?• 



Let A be the set of all the basic desire predicate atoms. Let 
X be a finite subset of A and F C P {X). Let <p be a pre- 
order on F. For a trajectory a let A {a) = {d G A\ a \^ d} 
i.e. the set of all the basic desires satisfied by a. Then we 
say that a satisfies {X, F, <f) if A (a) n X e F. We say 
that a trajectory a is preferred to a trajectory p3 with respect 
to {X, F, <f) if {X, F, <f) \= A{a) ^ a (/?). This will 
be denoted by {X, F, <p) |= a ^ /3. We say that trajec- 
tories a, p3 are indistinguishable with respect to (X, F, <p) 
if (X, F, <f) h a (a) « a {13). This will be denoted by 

{X,F,<F)h(^~P- 

Theorem 3. For a general preference formula <p there 
exists a pre-ordered PSC atom {X^,F^^<rj,) such that 
for two trajectories a, pi, a <^ /? in the sense of 
ASon and Pontelli 2006\) iff {X^ F^,<^) \= a ^ p 
and a k,cj, /3 in the sense of \Son and Pontelli 2006]) iff 
{X^,F^,<^)^a^(3. 

The proof, omitted due to space limitations shows how to 
construct {X^,F^,<^). 

The Computational Complexity of the Set of 
Preferred PSC Stable Models 

We can prove the following result on the computational 
complexity of finding a "preferred" PSC stable models of a 
PSC program. Please note that the theorem's preconditions 
are formulated to be useful for analyzing algorithmic imple- 
mentations of PSC programming as discussed in section 3. 

Theorem 4. Let P be a finite PSC program. Let At be 
the set of all atoms appearing in P and assume that At is 
finite. Suppose that for any subset M of At and any PSC 
atom {X, F, <f) or {X,F,pf) or any SC atom {X,F) 
determining the intersection M f] X and the membership 
M f] X G F can be done in polynomial time on the 
number of elements in M and X. If P is a pre-ordered PSC 
program, then suppose that for any PSC atom (X, -F, <f) 
in P for any two sets in F, the comparison operation <f on 
these subsets can be performed in polynomial time on the 
number of elements in the subsets. If P is a measure PSC 
program, then suppose that for any PSC atom (X,F,pf) 
in P and any subset A of F, the computation pF {A) can 
be performed in polynomial time on the number of elements 
of A. Then given M C At, the problem of determining 
whether M is a preferred PSC stable model of P for any 
of the induced pre-orders on stable models described in 
Section 3 is CoNP-complete relative to the size of P and 
the number of elements in At. 



Now, in ( Brewka, Niemela, and Truszczynski 2003) it 
was shown that the problem of deciding whether there ex- 
ists an answer set for an ASO program P = [Pgen, Ppref) 
is NP-complete and the problem of deciding whether S is 
an optimal model of P is coNP-complete. This is the com- 
plexity of the corresponding problems for PSC programs. 



That is, the problem of deciding whether there exists a stable 
model for a PSC program P is NP-complete and the prob- 
lem of deciding whether a PSC stable model M of a PSC 
program P is a preferred PSC stable model is co-NP com- 
plete. 

Conclusions and directions for further 
research 

In this paper, we have introduced an approach to speci- 
fying preferences in ASP called Preference Set Constraint 
Programming which is an extension of SC programming 
of dMarek and Remmel 20041 ). PSC programming uses two 
types of PSC atoms: pre-ordered PSC atoms and mea- 
sure PSC atoms. These atoms can be used to define pre- 
ordered PSC programs and measure PSC programs. For 
pre-ordered PSC programs, we have considered two ap- 
proaches for specifying preferences: "in common" and "in 
total". For the measure PSC programs we have consid- 
ered three approaches: "in common", "in total" and "in 
sum". We show that the problem of determining whether 
M is a preferred PSC stable models of a PSC program 
is CoNP-complete. To demonstrate the expressive power 
of PSC programming, we have shown that PSC program- 
ming can be used to express optimal stable models of ASO 
( Brewka, Niemela, and Truszczynski 2003), and the general 



preferences of Son and Pontelli (ISon and Pontelli 2006i It is 
also the case that the preferred stable models and the weakly 
preferred stable models of (IBrewka and Eiter 1999) can be 
expressed by an extension of PSC programming, although it 
was not discussed in this paper 

We have only briefly discussed implementations of PSC 
programming, but clearly it is an important issue for appli- 
cations. 

There are a number of areas for further research on PSC 
programming. One is to study the exact relationships be- 
tween PSC programming and other approaches for reason- 
ing with preferences. In particular, one must pay special at- 
tention to the efficiency of expressing preferences in any two 
systems that are being compared. A second is to study exten- 
sions of PSC programming where we add the ability of the 
user to express preference by preference orderings on rules . 
We will study both of these questions in subsequent papers. 

Finally, the five approaches for specifying preferences us- 
ing PSC programs can be viewed as special cases of the 
following generalization. A PSC system i? is a pair (P, <) 
where Pisa PSC program and < is a pre-order on the set of 
PSC stable models of P with the property that if A/i and 
M2 are PSC stable models of P such that pref {P,Mi) 
= pref{P,M2) and Mi < M2, then pref {P, Mi) ^ 
Ml -< M2 or pref (P, Mi) ^ Mi ~ M2 if P is a pre- 
ordered PSC program and pref (P, Mi) \= Mi -<^ M2 or 
pref (P, Ml) \= Ml «„ M2 if P is a measure PSC pro- 
gram. We suggest that one should study abstract properties 
of PSC systems. 
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